Bridging Bayesian and Minimax Mean Square Error Estimation via Wasserstein Distributionally Robust Optimization

نویسندگان

چکیده

We introduce a distributionally robust minimium mean square error estimation model with Wasserstein ambiguity set to recover an unknown signal from noisy observation. The proposed can be viewed as zero-sum game between statistician choosing estimator—that is, measurable function of the observation—and fictitious adversary prior—that pair and noise distributions ranging over independent balls—with goal minimize maximize expected squared error, respectively. show that, if balls are centered at normal distributions, then admits Nash equilibrium, by which players’ optimal strategies given affine estimator prior, further prove that this equilibrium computed solving tractable convex program. Finally, we develop Frank–Wolfe algorithm solve program orders magnitude faster than state-of-the-art general-purpose solvers. enjoys linear convergence rate its direction-finding subproblems solved in quasi-closed form. Funding: This research was supported Swiss National Science Foundation [Grants BSCGI0_ 157733 51NF40_180545], Early Postdoc.Mobility Fellowship [Grant P2ELP2_195149], European Research Council TRUST-949796].

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Distributionally Robust Stochastic Optimization with Wasserstein Distance

Distributionally robust stochastic optimization (DRSO) is a robust approach to stochastic optimization problems in which the underlying distribution is not known exactly. It seeks a decision which hedges against the worst-case distribution in an ambiguity set, containing a family of distributions relevant to the considered problem. Unfortunately, the worst-case distributions resulting from many...

متن کامل

Wasserstein distance and the distributionally robust TSP

Recent research on the robust and stochastic travelling salesman problem and the vehicle routing problem has seen many different approaches for describing the region of ambiguity, such as taking convex combinations of observed demand vectors or imposing constraints on the moments of the spatial demand distribution. One approach that has been used outside the transportation sector is the use of ...

متن کامل

Quantitative Stability Analysis for Minimax Distributionally Robust Risk Optimization

This paper considers distributionally robust formulations of a two stage stochastic programming problem with the objective of minimizing a distortion risk of the minimal cost incurred at the second stage. We carry out stability analysis by looking into variations of the ambiguity set under the Wasserstein metric, decision spaces at both stages and the support set of the random variables. In the...

متن کامل

Optimization of Generalized Mean-Square Error in Noisy Linear Estimation

A class of least squares problems that arises in linear Bayesian estimation is analyzed. The data vector y is given by the model y = P(Hθ + η) +w, where H is a known matrix, while θ, η, and w are uncorrelated random vectors. The goal is to obtain the best estimate for θ from the measured data. Applications of this estimation problem arise in multisensor data fusion problems and in wireless comm...

متن کامل

Rate-distortion function via minimum mean square error estimation

We derive a simple general parametric representation of the rate–distortion function of a memoryless source, where both the rate and the distortion are given by integrals whose integrands include the minimum mean square error (MMSE) of the distortion ∆ = d(X, Y ) based on the source symbol X , with respect to a certain joint distribution of these two random variables. At first glance, these rel...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Mathematics of Operations Research

سال: 2023

ISSN: ['0364-765X', '1526-5471']

DOI: https://doi.org/10.1287/moor.2021.1176